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(57) ABSTRACT 

Electro-optical display apparatus includes a plurality of 
modular units each having a projector for receiving electri- 
cal signals, converting them to optical images, and project- 
ing the optical images via an optical projection system onto 
a screen. The modular units are arranged in a side-by-side 
array such as to produce a combined display on the screen. 
A calibration system detects distortions in the combined 
display caused by the projection system of each modular 
unit and modifies the electrical signals applied to the pro- 
jector of each modular unit to correct the combined display 
with respect to the detected distortions. 

25 Claims, 34 Drawing Sheets 
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Fig. 3 
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Fig. 5 
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Fig. 8a 
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Fig. 8b 



Cross section 

of lamp 
Opening in tube 
"cover", 26b 




V-grooves 
filled with 
fluorescent 
material 



23 



Front (writing) 
side or screen 



Mylar sheet with 
rough surface 



10/17/2003, EAST Version: 1.04.0000 



U.S. Patent Apr. 17, 2001 Sheet 11 of 34 



US 6,219,011 Bl 



Fig. 9 
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Fig. 1 la 
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Fig. lib 
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Fig. 12b 
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Fig. 13 
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Fig. 14 
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Fig. 16 
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Fig. 16b 
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Fig. 17 
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Fig. 18 
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Fig. 19 
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Fig. 24 
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Fig. 25 
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Fig. 27 
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ELECTRO-OPTICAL DISPLAY APPARATUS 

FIELD AND BACKGROUND OF THE 
INVENTION 

The present invention relates to electro-optical display 
apparatus. The invention is particularly useful in large 
interactive displays of the type enabling one or more persons 
to interact with the display, by adding to, deleting from, or 
otherwise changing the displayed information; and the 
invention is therefore described below with respect to such 
an application. 

Various types of interactive displays are known, as 
described for example in U.S. Pat. No. 5,495,269 and WO 
95/34S81. Such known displays are generally constructed 
with the appropriately-sized screen according to the particu- 
lar application. Each display must therefore be specially 
designed for the respective screen size. Morocver, the depth 
of the display generally increases with the size of its screen. 

OBJECTS AND BRIEF SUMMARY OF THE 
INVENTION 

An object of the present invention is to provide displays 
which can be constructed so that they may be assembled in 
different sizes according to the respective application. 
Another object of the invention is to provide display appa- 
ratus which can be assembled to provide a relatively large 
size display but having relatively small depth. A further 
object of the invention is to provide an electro-optical device 
which can be used in an interactive manner by a user without 
the user obstructing the screen. A still further object of the 
invention is to provide a method of producing electro-optical 
displays of the interactive type. 

According to one aspect of the present invention, there is 
provided electro -optical display apparatus, comprising: a 
plurality of modular units each including a projector for 
receiving electrical signals, converting them to optical 
images, and projecting the optical images via an optical 
projection system onto the screen; the plurality of modular 
units being arranged in a side-by-side array such as to 
produce a combined display on a screen; the image sensor 
and imaging means being located on the same side of the 
screen as the projectors; the apparatus further comprising a 
calibration system including an image sensor for sensing an 
optical image on the screen, and imaging means, such as an 
imaging lens, for imaging the screen on the image sensor for 
detecting distortions in the combined display caused by the 
projection system of each modular unit and for modifying 
the electrical signals applied to the projector of each modu- 
lar unit to correct the combined display with respect to the 
detected distortions. 

According to further features in the described preferred 
embodiment, the screen is constituted of a plurality of 
modular unit screens, one provided on each of the modular 
units; and imaging means as set forth above for imaging the 
screen on the image sensor. 

According to still further features in the described pre- 
ferred embodiments, the screen is of a size and configuration 
to overlie all the modular units. In addition, the calibration 
system may also include a two-dimensional array of refer- 
ence points of known locations on the face of the screen. 

In one described preferred embodiment, the two- 
dimensional array of reference points is defined by the 
intersection points of a plurality of horizontal reference lines 
and a plurality of vertical reference fines on the screen. In a 
second described embodiment, the two-dimensional array of 
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reference points are the ends of optical fibers on the screen. 
The reference lines may also be the joint border lines of the 
individual module screens. In any case, the selected cali- 
bration technique may be used for on-line calibration or only 

s for off-line calibration. 

It will thus be seen that the foregoing features of the 
invention permit display apparatus to be constructed from 
one or more modular units of the same design, size and 
configuration, and to be assembled according to the particu- 

10 lar application. For example, apparatus can be assembled 
with two modular units arranged in a straight line, four 
modular units arranged in a 2x2 array, nine modular units 
arranged in a 3x3 array, etc., according to the size of the 
screen desired for the particular application. It will also be 

15 seen that the depth of the overall display will be the same 
irrespective of the size of the screen. 

Such an apparatus is capable of grabbing any image that 
appears on the screen, including images projected on the 
screen by a light projector or any hand- written script using 

20 dry -erase markers, electronic pens, etc. The apparatus can 
also grab the image of any object, e.g., documents, placed 
against the screen. Thus, the apparatus can be used not only 
for displaying documents, but also for storing or transmit- 
ting documents. Since the combined screen is not obstructed 

25 by the user, the user can conduct a natural flowing presen- 
tation. Since the system is modular, the configuration and the 
size of the combined screen can be fitted to any application; 
and since the system depth is relatively small, it may be used 
in office-like environments, or other space-limited 

30 environments, such as conference rooms, airport aisles 
(corridors), etc. 

The calibration system is preferably built into the appa- 
ratus as an integral part of the apparatus so that it can be 

35 conveniently used to recalibrate the system as frequently as 
may be desired, e.g., to compensate for the tendency of the 
opto-mechanical systems to drift with time and temperature. 
While the calibration system is particularly useful with 
respect to a large viewing area apparatus constructed of a 

40 plurality of modular units as described above, the calibration 
system could also be used in a single-unit setup. 

According to still further features in the described pre- 
ferred embodiments of both the multiple-unit and single-unit 
setup, the calibration system generates an image path cor- 

45 rection table for each unit for correcting discrepancies 
between the known locations of the two-dimensional array 
of reference points on the screen and the corresponding 
locations of the two-dimensional array of reference points as 
imaged on the screen. It also generates a projector-path 

50 correction table for each unit for correcting discrepancies 
between the known locations of the two-dimensional array 
of reference points on the screen and the corresponding 
locations of the two-dimensional array of reference points as 
projected on the screen. 

55 According to a yet further aspect of the present invention, 
there is provided a method of producing an electro-optical 
display comprising: providing a plurality of modular units 
each including a projector for receiving electrical signals, 
converting them to optical images, and projecting the optical 

60 images via an optical projection system on a screen; arrang- 
ing the plurality of modular units in a side-by-side array such 
as to combine their respective displays to produce a com- 
bined display; imaging the screen via imaging means, such 
as a lens, onto an image sensor for detecting distortions in 

65 the combined display; and modifying the electrical signals 
applied to the projector of each modular unit to correct the 
combined display with respect to the detected distortions. 
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Electro-optical display apparatus constructed in accor- FIG. 19 illustrates electro-optical display apparatus 
dance with the foregoing features may be used in a large including a plurality of projectors each equipped with a 
number of applications, including conference rooms, control Fresnel lens, and having a common diffusive screen to 
centers, and electronic bill-boards, as well as in front/rear produce uniformity from any viewing angle; 
large projection systems. s FK5. 20 is a schematic view of the Fresnel lens array in 

Further features and advantages of the invention will be the apparatus of FIG. 19; 
apparent from the description below. rgS. 21a, 21b and 21c, diagramatically illustrate the 

front, side and top of a projector provided with mechanical 
means for making some of the mechanical corrections as an 



BRIEF DESCRIPTION OF THE DRAWINGS 



The invention is herein described, by way of example alternative to digital corrections; 

only, with reference to the accompanying drawings, FIGS. 22a, 22b and 22c are diagrams from the front, side 

wherein: and top, respectively, illustrating more particularly one 

FIG. 1 diagrammatically illustrates one example of a manner of making some of the mechanical corrections of 
display apparatus in accordance with the present invention 15 FIGS. 21a-21c; 

including four modular units, and a combined screen over- FIGS. 23a, 23b and 23c are diagrams illustrating different 

lying the screens of all the modular units; camera positioning arrangements to allow better distortion 

FIG. 2 diagrammatically illustrates one construction of a correction; 

modular unit used in the display apparatus of FIG. 1; FIG. 24 is a flowchart illustrating one example of the 

FIG. 3 diagrammatically illustrates the optical system in ™ operations involved in using the camera positioning arrange- 

one of the modular units in the apparatus of FIG. 2; ment of mG - 230 for correcting color-convergence distor- 

FTG. 4 more particularly illustrates the folded mirror ^ 0DS m a s * n & & projector, 

arrangement in the optical system in one of the modular a FI( f S ' 25 ™ d 2 * are diagrams helpful in explaining the 



units; 



flowchart of FIG. 24; 



FIG. 5 diagrammatically illustrates another type of optical 25 nG : 27 > a , flowchart illustrating one example of the 

system that may be used in each modular unit; operations involved in similarly correcting geometrical dis- 

^ , mi - „ . tortious; 

FIGS. 6a-6e illustrate various types of distortions pro- , *™ . i- , . , • , . • 

duced in the optical systems of the modular units which and " G - » » * dla 8 ram tel P W m ex P lau >.ng the 

distortions are to be corrected by the calibration systems of 30 0WC ar 0 ' 

the modular units; DESCRIPTION OF PREFERRED 

FIG. 7 illustrates a calibration grid on the combined EMBODIMENTS 

screen used for calibrating the modular units; Modular Construction 

FIGS. Ha and Sb are longitudinal and transverse sectional FIG- 1 illustrates one form of display apparatus con- 
views along lines 8a— Sa and 8b— 8b, respectively, of FIG. 35 structed in accordance with the present invention and con- 
7 ; stituted of four modular units M a -M 4 arranged in a 2x2 

9 FIG. 9 diagrammatically illustrates one technique for ^ in abmtin S J eUtion SU£ * [ as l ° °° mt J ine *fir respective 

correcting non-uniformity in light intensity in the modular ^P^ 5 l ° P roduce « combined display The apparatus 

uu^. further includes a combined screen, generally designated 2, 

.„ , - , . , 40 of a size and configuration to overlie all the modular units, 

illustrates an alternative structure ; of a combined M fQm modular units afe of ^ same ^ ^ flnd 

screen for calibrating the modular units for both distortions configuration ^ that they can be ambled to produce a 

caused by the opUcal systems and non-uniformity in light combined scncn of the size and configura ti on des ired for 

intensity in the modular units; my particular application . 

FIGS. 11a and lib diagrammatically illustrate one tech- 45 The construction of each modular unit M 2 -M 4 is dia- 

nique for correcting spatial distortions in the imaging sys- grammatically illustrated in FIG. 2. Each modular unit 

tems of the modular units; includes a housing 3, and a rear projector 5 for receiving 

FIGS. 12a and 12b diagrammatically illustrate one tech- electrical signals, converting them to optical images, and 

nique for correcting spatial distortions in the imaging-path projecting the optical images onto screen 2 via an optical 

optical system, and in the projector optical systems, so projection system. The rear projector 5 is driven by a 

respectively, of the modular units; graphics computer 6 which receives the electrical signals via 

FIG. 13 diagrammatically illustrates one technique for an input port 7 from a systems computer SC. Graphics 

eliminating overlaps and gaps between the displays in the computer 6 is preferably constructed as a separate unit and 

screens of the plurality of modular units; not built into the module. 

FIG. 14 is a flowchart illustrating one example of the 55 Each modular unit further includes an image sensor 8 for 

overall calibration technique, constituted of the four receiving an optical image on the screen of the respective 

operations, A, B, C and D; urut v * a aa optical imaging system and for converting the 

FIG. ls'is a flowchart iUustrating operation Ain FIG. 14; *° electrical signals. These electrical signals are 

nr- ac n u n * *• «• r> • 1 a supplied to the graphics computer 6 for driving the rear 

FIG. 16 is a flowchart illustrating operation B in FIG. 14- n . t - 1 • f / , . . & - 
to r '60 projector 5 to mclude also the images appearing on screen 2. 

FIGS. 16a, Ub and 16c are flowcharts illustrating certain Rear pro j ector 5 & preferably an active color LCD (liguid 

sub-operations of operation B; Cfystal disp]ay) projcctor However, it could be a Digital 

FIGS. 17 and 17a taken together, constitute a flowchart Micromirror Device Projector, or any other known type of 

illustrating operation C in FIG. 14; projector. Image sensor 8 is preferably a CCD (charge 

FIG. 18 is a flowchart illustrating operation D in FIG. 14 65 coupled device) commonly used today in area cameras, 

for correcting non-uniformity in light intensity between the However, it could be any other type of image sensor, such 

various modular units; as a tube camera, a scanner, etc. 
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The graphics computer 6 receives electrical signals from it will be seen that the amount of distortion varies with the 

the image sensor 8, and from the systems computer SC via distance from the longitudinal axis LA and transverse axis 

the input port 7, and generates the signals (e.g., video TA FIG. 6b illustrates a barrel-type distorted image BDI 

signals) driving the rear projector 5. Graphics computer 6 with respect to the undistorted image UI. FIG. 6c illustrates 

further includes a built-in calibration system for calibrating 5 how a display combining the displays of the four modular 

the modular unit with respect to distortions (e.g., spatial, units Mj-M 4 would appear without correction of the dis- 

intensity, and color) in the projected images in the respective tortious produced in each of the four modular units, 

modular unit so as to reduce these distortions as appearing FIG. 6d illustrates an undistorted straight, horizontal line 

in the combined screen 2 for all the modular units. The UL, to be projected on the combined screen by the four 

calibrating system also eliminates overlaps and gaps in the 10 modular units Mj-M,; whereas FIG. 6e illustrates at DL^. 

combined display on screen 2 of the four modular unit how that line would be distorted by the pin-cushion effect, 

displays. and DSI the resultant screen image gray level if the distor- 

Optical Systems tions are not corrected. 

FIGS. 3 and 4 diagrammatically illustrate the optical When viewing a screen containing but a single display 

projection system for projecting the image produced by the 15 from a single modular unit, the optical distortions produced 

rear projector 5 of the respective modular unit on screen 2, by the optical system can frequently be passed without 

and also the optical imaging system for imaging the screen notice; however, when producing a combined image 

2 on the image sensor 8 of the respective modular unit. wherein a plurality (in this case four) displays are "stitched" 

Thus, as shown in FIGS. 3 and 4, the optical projection together in a "seamless" manner, geometric and color dis- 

system includes a lamp and reflector 10. This lamp may be 20 tortions produced in each modular unit are very much 

of any known type (e.g., tungsten halogen lamp, silver noticeable in the combined display. The major distortions 

halogen lamp, arc lamp, etc.) which illuminates, via a are: 

condensor lens 11 and IR/UV filter 11a, an LCD light i. Straightness distortions, resulting from the pin cushion 

modular panel 12 straddled by a pair of Fresnel lenses 13a, (PC) or barrel effect; 

13b. The image is magnified by a projection lens 14, and is 25 2 . Overlaps and gaps along the contiguous sides of the 

projected by folding mirrors 15a, 15b, 15c, onto the screen combined displays, resulting from the pin cushion (PC) 

2. The optical imaging system images the screen 2 onto the anc j Darre i distortions - 

image sensor 16 via mirrors 15a-15c and a lens system 17. 3 Non . umfonnly m illumination (monochromatic and 

The light reflected from the screen 2 thus represents a ^ tesulxin from differenc e S in the light-intensity 

combined image, namely a superposition of the image 30 leyel of ^ mdividual modu lar units; 

produced by each rear projector 5, and any image written or 4 Chromatic aberratioir 

projected onto the front side of the screen and imaged onto * ' 

the image sensor 8. The graphics computers 6 store a replica 5 * Ke y stone K**>) ettect J 

of the rear-projected images and of the captured combined 6 - differences in magnification (M) between adjacent 

image. From these two images, the system can determine the 35 projectors; 

user input, namely the image written or projected onto the 7 - rotation (R) distortion; 

screen from the front side of the screen. 8. translation (X,Y) distortion; and 

Alternatively another technique for grabbing the image 9. convergence (C) distortions inherent in individual 

written or projected on the front of the screen is by momen- projectors, 

tarily turning off the image produced by the rear projector, 40 The Calibration System 

and subsequently reading the image written or projected on It will thus be seen that in order to combine the displays 

the front side. This technique simplifies the determination of a plurality of modular units, a calibration system is 

process of the user input since the grabbed image does not needed to detect these distortions and to correct the com- 

include the rear projected image. bined image with respect to these distortions. The calibration 

Both the optical projector system and the optical imaging 45 system to be described below corrects for most of the above 

system inherently produce distortions, which are detected distortions. While the calibration system can be provided as 

and corrected by the graphics computer 6, as will be a separate system, to be used during the first setup of the 

described more particularly below, so as to produce a more display system or whenever else it may be desired to 

satisfactory display on screen 2 combining the images calibrate the system, the calibration system included in the 

generated by each of the modular units Mj-M 4 . 50 apparatus to be described below is built into the system as 

FIG. 5 diagrammatically illustrates another optical an integral part. It therefore has the important advantages 

arrangement that may be used for each of the modular units that it can be more frequendy used in a convenient manner 

M 1 -M 4 . As in FIG. 3, instead of using a common optical to correct for the tendency of optical-mechanical systems to 

system for combining the image projected by the rear- drift with time and temperature. 

projector 5 onto the screen 2 and the image of the screen 2 55 The built-in calibration system illustrated in FIG. 7 

received by the image sensor 8, the modular unit is provided includes a plurality of horizontal reference lines 20 and a 

with a separate optical projection system diagrammatically plurality of vertical reference fines 21 formed on the face of 

illustrated at 18, and a separate optical imaging system the combined screen 2 such that the intersection points of the 

diagrammatically illustrated at 19. However, in FIG. 5 the two groups of reference lines define a two-dimensional array 

projection system and the imaging system include a folded 60 or grid of reference points 22 of precisely-known locations 

mirror arrangement as in FIG. 4. on the face of the combined screen 2. As shown in FIGS. Sa 

Distortions Produced by the Opto-Mechanical Systems and $b, the reference lines 20 and 21 are produced by 

It is an inherent characteristic of optical systems that they forming V-grooves 23 on the face of the combined screen 2 

produce distortions when magnifying images. FIG. 6a illus- and filling the grooves with a luminescent material 24 which 

trates a rectangular undistorted or ideal image UI having a 65 is excited by a horizontal light source 25 extending along 

longitudinal axis LA and a transverse axis TA. FIG. 6a also one edge (the upper edge) of the combined screen 2, and a 

illustrates a pin-cushion type distorted image PDI, wherein vertical light source 26 extending along one side (the left 
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side) of the combined screen. Each of the two light sources the optical systems of the several modular units, and also 

25, 26 is enclosed by a reflector 25a, 26a, formed with an non-uniformity in the light-intensity levels of the modular 

opening 25b t 26b> facing the combined screen 2 so as to units, will now be described, for purposes of example only, 

direct the light towards the luminescent material 24 carried with reference to the diagrams of FIGS, lla-13 and the 

by the combined screen. Preferably, the luminiscent material 5 flowcharts of FIGS. 14-18. 

24 is an ultraviolet (UV) fluorescent material, and the light FIG. 14 is a general flowchart illustrating the overall 

sources 25, 26 are UV light sources which cause the material calibration technique. The calibration is constituted of four 

24 to fluoresce. main 0 p Crat j onSj designated Operations A, B, C and D, 

As one example the combined screen 2 may be con. respectively, as appearing in blocks 51-54. 

structed of a rigid light transmissive (translucent) pane 27 ^ ^ of the 

formed on its inner face 27a with the V-grooves 23 filled " . , j . . ... ,. ., , 

with the luminescent material 24 defining die grid of refer- ma 8 m g P ath ,n e f ch module - In tt « °P«ation, the distor- 

ence lines 20, 21, the opposite face 27b of the transparent U0DS m m6 "P*? 1 ™ 4 8 n, 8 ^ & ° m ^ screen 2 to the 

panel serving as a write-on surface by a user. The combined ma g e sensor 8 m the respective module, are detected and 

screen 2 further includes a flexible plastic sheet 28, e.g., of corrected by the graphics computer 6 of the respective 

"Mylar" sheet material having a rough surface, covering the 15 module. This operation is more particularly illustrated in the 

grooved face 27a of the transparent panel 27 and the flowchart of FIG. IS. 

luminescent material 24 within the V-grooves 23. Operation B, block 52, involves the calibration of the 

The two-dimensional array of reference points 22, defined projector path in each module. In this operation, distortions 

by the intersections of the horizontal and vertical lines 20, in the optical projection system, from the rear projector 5 to 

21, is used for detecting and correcting distortions caused by 20 the screen 2, are detected and corrected also by the graphics 

the optical systems in each modular unit, as described more computer 6 of the respective module. This operation is more 

particularly below. particularly illustrated in the flowcharts of FIGS. 16, 16a, 

FIG. 9 diagrammatically illustrates a technique that may 16b and 16c. 

be used for calibrating for non-uniformity in the light Operation C, block 53, involves the calibration of the 

intensity of the modular units Mj-M,,. For this purpose, the M array 0 f projectors in the plurality of modular units Mj-M 4 

combined screen 2 is provided with a plurality of optical t0 fi ne .tune the combined image projected on the combined 

fibers 30 having one of their ends 31 located on the inner 2> mcluding eliminating overlaps and gaps between 

face of the combined screen 2 to sense the light intensity at ^ dis , m each of tne modules caused b distortio ns to 

die respective location. The opposite end of each optical (he ica , ffls ^ ^ ag weU as ^ othef 

fiber 30 is connected to a light detector 32 producing an M prev 4 s i y . described distortion-correction operations, is 

output corresponding to the light ^intensity at the respective fomed b me hics ter 6 m the respective 

location 31 The outputs of hght detectors 32 are connected ^ M M and ^ b ^ s sc 

to a control circuit 33 which controls the intensity of the whjch ^ ^ ^ ^ u jn , he 

fight sources m the rear projectors (5, FIG. 2), constituting flowchar(s of FIGS 17 and 17o . 

the projection system designated by block 34 m FIG. 9 so 3J 0 Uon D block 54 involves me calibration for non . 

as to reduce non-uniformity in the light intensities of the uniformit m M ht mtcnsit l6Ve]s all ^ modules . ,„ 

hght sources in the modular units. The imaginR system 35, ^ ; ^ m inUnsi , evels Qf ^ ^ 

including the hghtsensors 8 of the nodular units, is separate . * oa ^ ^ from ^ ^ modular ^ are 
from nw pro i crtinn Wtrm 34 similar tn fhr arnncM fllZ. detec(ed and conlrolled t0 reduce „ 0 n-uniformity. This 

- ^/ ' i'J-n * S " C""<r n 1 s u thc , co " tro1 a ™ lt W ~ . . 40 operation is also performed by the graphics comcuterToT 

FIG. 10 illustrates another technique that may be used for ■ £ mfU[jar M we „ J 1^ th ^ Rtem!i c^^S/CL 

detecung and correcting not only distortions in the optical - \\\ ,^, H „ l! ir uni ' ts and is ilhlsliat ^ in the 

systems of the respective modular units Mj-M^ but also ^ m y r n nrt nf pf ft ■ 1 ft ~ * 

non-uniformity in the hght intensities of the projector Operation A (FIG IS) 

devices in these modular units. As shown in FIG. 10 ^ ^ shown rf mG 15 0 

combined screen 2 includes a plurality <of optical fibers 41 ^ A(block 51 FIG 14) the ^ ^ ^ t0 eKI ^ me ^ 

having one of their ends 42 embedded in the face of the ^ 25 26 (RG ^ of ^ &st modular ^ M ^ Qrdcr 

combined screen at precisely-known locations to define the , o duce ^ ^ moduJar ^ me refcrenoe ^ M 

two-dimensional array of reference points of known loca- n ^ ?) dcfinin aJ ^ intersections 22 [hc 

bona on the face of the combined screen. The opposite end 5Q of refcrence mts of kn0WQ locations on 

of each optical fiber 41 is connected to a hght emitter 43 ^ face rf ^ combjned 2 Bfe fc b 

(e.g. a LED), and also to a hght sensor 44 (e.g., a block n m H& ^ ideal ^, oduced b these 

photodetector) via a beam splitter cube 45. The light emitter reference ljnes ^ fa horizontal Unes HLo-HL, and 

43 and hght sensor 44 of each optical fiber 41 are connected ^ yi^-VL,, respectively, in FIG. 11a. 

in parallel so as to be selectively enabled. The image sensor 8 in the respective module grabs the 

Thus, when the optical fibers 41 are to be used for fa duced 0Q , he ^y^j „„„ 2 for respective 

producuig the two-dunens.onal array of reference points 42 moduk (Wock fi2) Ho because of lhe distortions 

(corresponding to reference points 22 in FIG. T), the tight cmxd b ^ ical ^ ^ ima ^ th frQm , he 

emitters 43 of the optical fibers 41 are energized; and when saeeD 2 ^ ^ im sensof g ^ acWal ^ <lseen „ b 

the optical fibers 41 are to be used for detecting and 6Q ,h e ^ ^ not me ideai grid mustrated m nG . llo, 

correcting non-uniformity m tight intensity of the rear but ^ ^ rfd mustrated m FIG . ufc . n,^ b( 

projectors in the modular units, the light sensors 44 are wherMS ^ ^ horizonla] ^ ver)ical lin6S m thc ideaJ grid 

ena e * of FIG. 11a are straight and perpendicular to each other, in 

Operation the distorted grid illustrated in FIG. 11£> all the horizontal 

Overall Operation 65 lines HLor-HLg. and vertical lines VL' 0 -VL' 6 (except lines 

One manner in which the above-described calibration HL3 and VL3 along the longitudinal axis and the transverse 

systems are used for detecting and correcting distortions in axis TA) are distorted because of the inherent distortions of 
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the imaging-path optics. These distortions increase with the 
distance of the respective line from the longitudinal axis LA 
and transverse axis TA. 

The intersection points of the horizontal and vertical 
reference lines, defining the two-dimensional array of ref- 
erence points, are determined in the distorted grid of FIG. 
lib (block 63), and are correlated with the known locations 
of the reference points in the ideal grid of FIG. 11a (block 
64). The graphics processor 6 for the respective module then 
calculates a two-dimensional, best-fit cubic function for 
transforming the intersection points of the distorted grid to 
those of the ideal grid. Such calculations are well known; see 
for example "Image Reconstruction by Parametric Cubic 
Convolution" by Stephen K. Park and Robert A. 
Schowengerdt, published in "Computer Vision, Graphics 
and Image Processing" 23, 258-272. This procedure is 
performed for each horizontal pair of lines (box 65), and for 
each pair of vertical lines (box 66). 

A two-dimensional Image-Path Correction Table is then 
produced and stored in the graphics computer 6 for the 
respective module for each of the reference points in two- 
dimensional array reference points (block 67). The forego- 
ing steps are then repeated N 2 -N 4 for all the remaining 
modules M 2 -M 4 (block 68). 

The result of blocks 65 and 66 is a set of distortion 
functions for each horizontal line 20 and each vertical line 
21 of the stored ideal grid (FIG. 7), i.e., seven (in the 
described example of FIG. 11a) horizontal functions and 
seven vertical functions. The Image-Path Correction Table 
calculated in block 67 is a correction table which enables the 
system hardware to convert the grabbed distorted images of 
the imaging path into distortion-free images. 

The above-described technique for performing Operation 
A has a number of advantages, including the following: The 
calculation of a best-fit function filters out (smoothes) any 
local noise generated by the imaging path, or local error in 
the reference grid. In addition, the calculation of a cubic 
function for each reference line enables determination, by 
interpolation, of all the other points that are not on the 
reference grid. In addition, the representation of the distor- 40 
tation data by a cubic function (as distinguished from a 
table) enables handling and storing the data in a more 
compact manner. 

Operation B (FIGS. 16, 16a, 16b, 16c) 

FIG. 16 illustrates the steps of Operation B (block 52, 45 
FIG. 14) involving the calibration of the projector path in 
each module. This operation detects the distortions produced 
in the projector path optics, i.e., from the rear projector 5 of 
the respective module to the combined screen 2, and pro- 
duces a Projector Path Correction Table for correcting these 
distortions. 

Thus, as shown in FIG. 16, the stored ideal grid (FIG. 11a) 
is projected onto the combined screen 2 (block 71), which 
image is distorted by the projector path optics. The projected 
image is partially reflected from the screen onto the image 
sensor (8, FIG. 2) of the respective module (block 72), 
which grabbed image is distorted by the distortions in the 
imaging-path optics. This distorted image of the grid is 
illustrated in FIG. lib. 

The graphics processor (6, FIG. 2) of the respective 
module corrects the intersection points (reference points) in 
the distorted grid (block 73) according to the flowchart 
illustrated in FIG. 16a. Thus, as shown in FIG. 16a, for 
every pixel in the grabbed image, a calculation is made from 
the Image-Path Correction Table (produced in Operation A 65 
according to the flowchart of FIG. 15) of the four surround- 
ing grid reference points; and then by using bi-linear inter- 
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polation (block 13b), each such pixel is relocated to the 
correct location. 

The steps of blocks 73a, 73b in the flowchart of FIG. 16a 
are more particularly illustrated in the diagram of FIG. 12a. 
Thus, the location of the distorted pixel in the distorted grid 
is indicated at DP, and the locations of the four surrounding 
pixels in the distorted grid are indicated at DPj-DP,,. The 
locations of the corresponding four pixels on the ideal 
(corrected) grid are indicated at CPj-CP 4 ; and the corrected 
location of the corresponding pixel is indicated at CP. 

Following the steps indicated by block 73 in FIG. 16 (and 
blocks 73a, 73b in FIG. 16a), the graphics computer of the 
respective module has now an image of the projected screen 
that is free of the distortions of the imaging-path optics, and 
includes only the distortions of the projection-path optics. 

A Projection-Path Correction Table is then calculated for 
the projection path optics (block 74). The Projector- Path 
Correction Table provides, for every ideal -grid reference 
location, the correct locations of the projected reference 
points in the distorted grid. The manner in which the 
Projector-Path Correction Table (block 74) is calculated is 
more particularly illustrated by steps 74a-74/ in FIG. 16£>. 

As shown in FIG. 16, a check is made as to whether the 
distortion is smaller than the threshold (block 75). If not (i.e., 
the distortion is larger than the threshold) the correct loca- 
tion of the reference point is determined and stored accord- 
ing to the flowchart illustrated in FIG. 16c and the diagram 
of FIG. Mb. 

Thus, for every pixel in the projected image (PP, FIG. 
12b) a determination is made from the Projector-Path Cor- 
rection Table of the four surrounding grid reference points 
PP 1 -PP 4 (blocks 76a, FIG. 16c). By using bi-linear inter- 
polation (block 76b), the corresponding points CP X -CP 4 on 
the ideal correct grid are determined for relocating the pixel 
to the correct location CP (block 76b). 

After the above-described distortion calibration has been 
completed for the projector path of the respective module 
(block 76), the procedure is repeated with respect to the 
other three modules M 2 -M4 (block 77). Upon the comple- 
tion of Operation B for all the modulator units, the projector 
of each modular unit is now corrected for distortions in their 
optical systems. 
Operation C (FIGS. 17, 17a) 

Operation C (block 53, FIG. 14) is now performed to 
calibrate the array of projectors to form one combined 
projector image. In this operation, the projector displays of 
the four modular units are treated as four tiles with parallel 
coordinate systems on the plane of the combined screen 2, 
and are electronically moved vertically and horizontally 
until they cover the face of the combined screen 2 with no 
overlaps and no gaps. This operation is more particularly 
described in FIGS. 17 and 17a, and is illustrated in the 
diagram of FIG. 13. 

Thus, as shown in FIG. 17, the horizontal lines are 
projected from the first module (block 81), and the image of 
the horizontal lines from the imaging path of the first module 
is grabbed (block 82). The horizontal lines from the second 
module are then projected (block 83), and the image of the 
horizontal lines from the imaging path of the first module are 
grabbed (block 84). The location of the stored image in the 
projector of the second module is then moved laterally by a 
horizontal offset, and vertically by vertical offset, until the 
lines are aligned (block 85). The foregoing steps are 
repeated for the third and fourth modules by calculating the 
horizontal offset and vertical offset for these modules (block 
86). 

The same procedure is then repeated for the vertical lines 
(block 87), as more particularly set forth in the flowchart of 
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FIG. 17a, where the corresponding steps are indicated by 
blocks 81a-&7f. 
Operation D (FIG. 18) 

Upon the completion of Operation C (block 53, FIG. 14), 
Operation D is performed (block 54, FIG. 14) for detecting 
and correcting non-uniformity in the light intensity among 
all the modules. This operation is more particularly illus- 
trated in the flowchart of FIG. 18, and uses the light intensity 
detectors (optical fibers 30 of FIG. 9, or 41 of FIG. 10) for 
this purpose. 

In calibrating for non-uniformity in illumination on the 
combined screen 2, the following assumptions are made: 

1 . Illumination differences between the modules are glo- 
bal in nature, meaning that the non-uniformity profiles of the 
modules are similar in shape, but non-similar in amplitude. 
The difference between the ampliudes is a result of differ- 
ences in the brightness of the lamps in each module and 
differences in the optical attenuation of each module. 

2. The variation of illumination within each module are 
gradual at very low spatial frequency. 

3. The non-unformity of the illumination of the screen of 
each module may behave according to a known physical 
behavior, e.g., according to the following: 

/-fc*cos(0)**4 Eq. 1 

wherein: 

^illumination brightness on the screen as seen by the 
viewer; 

0=angle of point on screen relative to optical axis; 
k=arbitrary coefficient. 

For a module with focal length=100 cm, projection area« 
60 cmx80 cm, the falloff in the comer of the screen is 
-31.4%. This falloff is very gradual and has a circular 
symmetry, relative to the optical axis of the module. 

As shown in FIG. 18, the calibration of illumination 
non-uniformity involves two major steps: 

1. Calibration of known non-uniformity (e.g., as described 
above) within each module's field. 

This non-uniformity will be corrected, for each module, 
by adjusting the gray level of each module stored image. The 
adjustment of the gray level uses the light-modulator's 
capacity to modulate its transparency in an almost continu- 
ous way. As an example, assume that a uniformly white field 
is to be projected on the entire module's screen, having the 
parameters mentioned in assumption (3), and that the light 
modulator has 256 gray levels. The graphics processor will 
generate an image which has a value of 255* (1-0.3 14), or 
175 gray levels in the middle pixels of the screen, and 255 
in the corner pixels. The gray level of the other pixels will 
be calculated in accordance with Eq. 1. These values will 
cause the light modulator to attentuate the transmitted light 
in such proportion that the illumination on the module's 
screen will be flat (uniform) over the entire face of the 
screen. 

The foregoing operation is implemented by blocks 90 and 
91 in FIG. 18, and will be used for all modules. The result 
of this operation is that within each module, the screen's 
brightness is uniform, but the average brightness level of the 
modules will vary from module to module. The difference 
between the modules is calibrated in the next step imple- 
mented by blocks 92 and 93. 

2. Calibration of differences between the modules: 

As mentioned before, the assumption is that after step (1) 
(blocks 90, 91) of the calibration, the field of each module 
is uniform, but the average (DC) level of the module is 
different, from module to module. Therefore, in order to 
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calibrate for differences between the modules, the system 
uses sensing detectors in each module which are capable of 
reading the average brightness level of light projected on the 
screen. As described above, the light sensors are comprised 

5 of optic fibers whose tips are attached to the face of the 
screen, shown at 31 in FIG. 9, and at 42 in FIG. 10. Each 
fiber tip collects a fraction of the light projected on the 
screen and transfers this light to the light detector. The fiber 
by itself interferes minimally with the projected image due 

10 to the fact that the fiber is extremely thin (around 100 /an) 
and the fact that only the fiber tip is close to the screen, 
whereas most of the fiber length is away from the screen and 
out of focus. The light sensors readout (of the light level 
projected on the screen) will be inputs to the graphics 

15 processor. The graphics processor will use this input to 
calculate the difference between the modules and to control 
the attenuation of the light modulators, as described in step 
(1) of the calibration. 

Following is one example of a design: projector lens, 

20 El-Nikkor, f=135, f/5.6; imaging lens, Panasonic WV-Lf6; 
LCD panel, Sharp model LQ64P312; light source, 400 watt 
Tungsten-Halogen lamp. Osram HLX 64665; and graphics 
computer, Texas Instruments TMS320C80. 
Screen Structure 

25 FIGS. 19 and 20 illustrate four projectors 100 (only two 
of which are seen in the top view of FIG. 19), each having 
a drive 102 providing six degrees of movement. Each 
projector includes a Fresnel lens 104 which collimates the 
light from the respective projector. All the Fresnel lenses are 

30 covered by common screen 106, e.g. constructed with a 
lenticular or a diffusing surface, for scattering the light and 
thereby providing more uniformity from any viewing angle. 
A blocking element 108 is mounted by a member 110 to 
underlie the junctures between adjacent Fresnel lenses 104 

35 in order to reduce overlapping of the light from the projec- 
tors and thereby to produce a seamless combined display. 
Correcting Distortions Mechanically 

The following distortions can be corrected mechanically 
or optically: 

40 1. straightness distortions and overlap gaps both resulting 
from the Pin Cushion (PC) and barrel distortions; 

2. keystone effect; 

3. magnification differences between adjacent projectors; 
45 4. rotation distortion; and 

5. translation distortion. 

FIGS. 21fl-21c also illustrate how the drives 102 of the 
projectors 100 can be controlled for correcting translation 
distortions (x, y), rotation distortions (R), magnification 

50 distortions (M), and also distortions due to the Keystone 
effect (KS^ KS^). Pin cushion (PC) and barrel distortions 
can be corrected by using curved minors, e.g. for one or 
more of the folding mirrors 15a-15c in FIG. 4. Color 
convergence distortions, however, may be corrected digi- 

55 tally by moving the respective pixel elements the required 
sub -pixel distances as described earlier. 

FIGS. 22fl-22c are front, side and top views, respectively 
illustrating one manner of providing each projector drive 
102 with six degrees of movement. Thus, the arrangement 

60 illustrated in FIGS. 22a-22c includes seven plates 111-117 
supported one on top of the other, the upper most plate 117 
supporting the projector 100. Plate 112 is movable vertically 
with respect to plate 111 to correct for y-translation distor- 
tions; plate 113 is slidable horizontally on plate 112 to 

65 correct for magnification differences (M); plate 114 is mov- 
able on plate 113 along the x-axis to correct for X-translation 
distortions (X); plate 115 is pivotaJly mounted to plate 114 
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about axis 115a (FIG. 22c) to correct for the Keystone 
distortions KSy; plate 116 is pivotaUy mounted about a 
central axis U6a to plate 115 to correct for the Keystone 
distortions KSy; and plate 117 is pivotal about pivot 117a to 
plate 116 to correct for rotational distortions (R). S 

FIGS. 23a-23c illustrate different camera posationings 
with respect to the screens (preferably normal to the screen 
in a symmetric way) for the four projectors. Thus, FIG. 23a 
illustrates four cameras 121-124 each located to image the 
center of the respective projector screen 131-134; FIG. 236 10 
illustrates the four cameras 141-144 located to image the 
edges of the four screens 151-154; and FIG. 23c illustrates 
five cameras 161-165 located to image the corners of the 
four screens 171-174. The edge positioning arrangement 
illustrated in FIG. 23b, and the corner positioning arrange- 15 
ment illustrated in FIG. 23c, allow better distortion 
correction, since the same camera views more than one 
module image and can be centred around a more problem- 
atical region. 

Correcting Color and Intensity Distortions 20 

The correction of color distortions is done by modifying 
the R/G/B components of each projected pixel. Intensity 
uniformity correction is done by the same mechanism and is 
practically a side effect of the color correction mechanism. 
For example, if G and B (i.e. the Green and Blue 25 
components, respectively) are not changed and R (the Red 
component) is multiplied by 0.5, then the pixel becomes less 
"reddish". However, If G, B and R are all multiplied by 0.5 
then the hue is unchanged but the intensity decreases. 

There are two main physical reasons which cause color 30 
and intensity distortions. The first is the fact that each 
projector uses its own lamp to project the image, and each 
lamp has a unique emitted spectra signature which is deter- 
mined by the exact manufacturing conditions and which is 
also changed over time (generally, the emitted light gets 35 
"redder" and the intensity gets lower as time evolves; this is 
true for metal-halide lamps which are commonly used in 
projectors. Thus each projector produces slightly different 
colors relative to its neighbours. The second reason (which 
mainly applies to intensity corrections) is a non-uniform 40 
light intensity (generally the center of the image is more 
illuminated than the outer parts) emitted from the projector 
due to the internal optical system. 

There are two distinct operations that are done in the 
system regarding color (and hence, intensity) correction: 45 

(1) Estimation of the color distortions (which is done as 
part of the calibration phase). 

(2) Color correction of all the pixels in each projected 
frame (which is done by the hardware which controls the 
projector). 50 

The color distortions estimation is done as part of the 
system calibration phase. It is based on using the video 
cameras (CCDs) as color measuring tools. Each camera is 
aimed towards the border of a plurality of adjacent regions, 
e.g., as shown in FIG. 23f> or FIG. 23c. Thus the camera is 55 
used first of all to measure the relative color differences 
between neighboring projectors. This is done by repeating 
several times the following basic step (which is comprised 
of the following operations): 

(1) Project the same color and intensity (i.e. the same 60 
R/G/B digital values) by the two (or four) adjacent projec- 
tors. 

(2) Capture a snapshot of the area covered by the projec- 
tors. This step may be repeated several times to improve the 
SNR by averaging the snapshots. 65 

(3) Analyze the captured image to estimate R/G/B, of the 
two (or more) projectors, as seen by the camera e.g., in the 



FIG. 23fc or 23c arrangement. This is done by simply 
averaging the pixels which were projected by each projector 
separately. 

This basic step is repeated many times for various R/G/B 
configurations subject to the limitation that only one color 
component takes a non-zero value. There is no need to 
measure complex R/G/B configurations since they are all 
linear combinations of the basic R/O/O, O/G/O and O/O/B 
patterns. 

The next step is to convert the R/G/B; measurements to 
the CIE-XYZ chromatid ty coordinates system. This is a 
problem which is solved in the literature, see for example: 
"Connoly C, Leung T W. W. and Nobbs J., 'The Use of 
Video Cameras for remote Colour Measurement', submitted 
to Journal of Society of Dyers and Colorists, February 
1995". 

The problem to be solved now is well known in the 
literature as "Gamut Mapping" (or alternatively as "Color 
Space Transformation"). The objective is to present a col- 
ored image using a restricted set (i.e. reduced space) of 
colors so that it will be seen by an average human viewer as 
close as possible to the original image. Good references are: 
Roy Hall, "Illumination and Color in Computer Generated 
Imagery", (Spring Verlag 1989) and "Device Directed Ren- 
dering" by A. S. Glassner et al, ACM, Transaction on 
Graphics, VOL 14 No. 1 January-95; pages 58-76. 

The color correction is done on each pixel by the hard- 
ware. The correction comprises three operations: 

(1) Linearization: Using a table look-up, each of the 
R/G/B values is replaced by X=X Y -X 0 where X stands for 
R/G/B respectively and y (Gamma) is a known constant 
characterizing the electro-optical properties of the projector. 
This step is called "linearization" since the new values are 
linearly proportional to the physically measured illumina- 
tion produced by the projector. 

(2) Transformation: A simple linear transformation (using 
a 3x3 matrix) which result in a new R/G/B triplet. 

(3) De-Linearization: The inverse operation of the first 
step is performed to prepare the R/G/B values properly to be 
projected by the projector (which applies a built-in gamma 
on its digital input). 

The flowchart of FIG. 24 illustrates the foregoing steps 
involved in the correction for color convergence distortions 
in a single projector, and the diagram of FIGS. 25 and 26 
illustrate this operation. Completion of the four steps set 
forth in the flowchart of FIG. 24 results in a correction table 
in which each color pixel has been moved the required 
sub-pixel value to correct for color convergence distortions. 
Correcting Geometric Distortions 

The following description presents an alternative embodi- 
ment to operations B and C which are presented in FIG. 14 
as part of the main embodiment. 

This alternative embodiment is based on the existence, 
and the possibility to detect, fixed reference lines which are 
located exactly between the adjacent Fresnel lenses. By 
adjusting the shape of each projected image to fill precisely 
into the rectangle formed by the reference lines, the need in 
global adjustment (i.e. the above mentioned operation C) is 
avoided. The detection of the reference lines is enabled by 
the fact that the camera receives light emitted from the back 
side of element 108 (in FIG. 19). 

Image shape adjustment is done digitally by implement- 
ing a well known resampling algorithm (as in the above 
mentioned operation B). The resampling is done on each 
projected image separately in exactly the same manner. The 
resampling is done using a non-varying non-homogenous 
non-linear pixel distribution. Thus means that the location of 
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each resampled pixel is pre-deteimined once using a com- 
plex formula which takes into account the pixel desired 
location on the screen, and various distortion parameters 
which characterize the projector. For example, if it is found 
that the projector is misaligned by 0.5 pixel to the right 
(denoted as X=0.5) when projecting the original image, then 
each projected pixel int he reshaped image is resampled 0.5 
pixel to the left of the corresponding original pixel. The 
actual formula in this embodiment similarly takes into 
account vertical shift (denoted as Y), zoom factor (M), axial 
rotation (R), horizontal and vertical keystone (KSx,KSy) 
and the Pin Cushion effect (PC) or barrel effect. 

These distortion parameters are found once during the 
system calibration step using the algorithm illustrated in 
FIG. 27, as follows: 

Each module is calibrated separately in this scheme. The 15 
algorithm starts by setting all the distortion parameters of the 
current module (which are initially known) to zero (step 201, 
FIG. 27). This results in projecting images just as they are, 
with no reshaping. The algorithm uses only one type of 
image, which is a rectangle internal to the reference lines (as 20 
can be seen in FIG. 28). The distance between the points 
forming the internal rectangle to the external rectangle 
(formed by the reference lines) is constant. The algorithm is 
iterative, trying to improve the values of the distortion 
parameters in each iteration. 

In step 202 (FIG. 27), an image forming an internal 
rectangle, corrected using the current values of the distortion 
parameters, is projected. In step 203 the image is captured 
and the distances shown in FIG. 28 are measured. In step 
204 the corrections to the distortion parameters (i.e., dX, dY, 
dM, etc.) are computed using the distances measured in step 
203. The following is the heart of this algorithm: if the 
distortion parameters are correct, the internal rectangle is 
projected properly; hence all the distances measured in step 
203 are equal, and the quantities calculated in step 204 are 35 
all zero. 

In step 205 the distortion parameters are updated using the 
corrections found in step 204 using expressions such as: 



25 



30 



images, and projecting said optical images via an 
optical projection system onto a screen; 
said plurality of modular units being arranged in a side- 
by-side array such as to produce a combined display on 
said screen; 

said apparatus further comprising a calibration system 
including an image sensor for sensing an optical image 
on said screen, and imaging means spaced from the 
screen and producing an image of the screen on said 
image sensor, for detecting geometrical distortions in 
said combined display caused by said projection system 
of each modular unit and for modifying the electrical 
signals applied to said projector of each modular unit to 
correct said combined display with respect to said 
detected geometrical distortions; 

said image sensor and imaging means being located on 
the same side of the screen as the projectors for the 
plurality of modular units; 

said calibration system further including a two- 
dimensional array of reference points of known loca- 
tions on the face of said screen, and means for gener- 
ating a projector-path correction table for each modular 
unit for correcting discrepancies between the known 
locations of said two-dimensional array of reference 
points on said screen and the corresponding locations 
of the two-dimensional array of reference points as 
projected on said screen. 

2. The apparatus according to claim 1, 

wherein said screen is constituted of a plurality of modu- 
lar unit screens, one provided on each of said modular 
units; 

and wherein said imaging means includes an imaging lens 
for each modular unit for imaging its respective modu- 
lar unit screen on said image sensor. 

3. The apparatus according to claim 1, wherein said 
imaging means is an imaging lens, and said screen is of a 
size and configuration to overlie all said modular units. 

4. The apparatus according to claim 1, wherein said 
two-dimensional array of reference points are defined by the 



X=X+dX, Y=Y+dY, etc. The exact expressions are specific 

to the iterative algorithm used to control the convergence of 40 intersection points of a plurality of horizontal reference lines 
the distortion parameters. One possible algorithm is the and a plurality of vertical reference lines on said screen. 
"Direction Set" (or "Conjugates Gradient") technique (such 5. The apparatus according to claim 4, wherein said 
as described in "Numerical Recipies in C by W.H. Press, B. horizontal and vertical reference lines are produced by 
P. Flannery, S. A. Teukalsky and W. T. Betterling, Cam- luminescent material carried on a face of said screen, and a 

bridge University Press, ISBN-0-521-35465-X, Chapter 10 as light source for exciting said luminescent material to cause 
(Minimization or Maximization of Functions), First Edition, it to emit light. 

1988). 6. The apparatus according to claim 5, wherein said screen 

In step 206 the relative change in the distortion param- is a light-transmissive screen and said reference lines of 
eters is evaluated. If this value is close enough to zero, then luminescent material are on the rear face of said screen, the 

the algorithm stops. Otherwise, a new iteration is started by 50 front face of said screen serving as a writing surface, 
going back to step 202. However, this time the internal 7. The apparatus according to claim 1, wherein said 

rectangle is resampled in a different way than in the previous two-dimensional array of reference points are the ends of 
iteration. Hence it is projected in a form which is closer to optical fibers on said screen. 

a perfect rectangle as it should be. 8. The apparatus according to claim 1, wherein said 

While the invention has been described with respect to 55 calibration system also generates an image path correction 



several preferred embodiments, it will be appreciated that 
these are set forth merely for purposes of example, and that 
many changes may be made. For example, each modular 
unit could include its own screen, with a separate combined 
screen applied to overlie all the screens of the modular units. 
Also, the calibration operations can be performed by an 
external computer. Many other variations, modifications and 
applications of the invention will be apparent. 
What is claimed is: 

1. Electro-optical display apparatus, comprising: 
a plurality of modular units each including a projector for 
receiving electrical signals, converting them to optical 



table for each modular unit for correcting discrepancies 
between the known locations of said two-dimensional array 
of reference points on said screen and the corresponding 
locations of the two-dimensional array of reference points as 
60 imaged on said screen. 

9. The apparatus according to claim 1, wherein said 
calibration system also utilizes said two-dimensional array 
of reference points on said screen to combine the displays 
such as to eliminate overlaps and gaps in said combined 

65 display. 

10. The apparatus according to claim 1, wherein said 
screen further includes a plurality of optical fibers having 
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one of their ends at a plurality of spaced locations on the the intersection points of a plurality of horizontal reference 

inner face of said screen for sensing the light intensity at said lines and a plurality of vertical reference lines applied to said 

locations; screen. 

and wherein said apparatus further includes light detectors 16. The method according to claim 15, wherein said 

connected to the opposite ends of said optical fibers 5 horizontal and vertical reference lines arc produced by 

producing electrical outputs corresponding to said depositing luminescent material on the face of said screen, 

sensed light intensity, and a control circuit for control- and exciting said luminescent material by a light source to 

ling the optical projectors of said modular units to make cause it to emit light 

uniform their light intensities. 17. The method according to claim 16, wherein said 

11. The apparatus according to claim 1, wherein: 10 reference lines of luminescent material are applied to the 
each of said projectors includes a drive having a plurality rear face of said screen, the front face of said screen serving 

of degrees of movement; as a writing surface, 

and said calibration system also corrects at least some of 18. The method according to claim 14, wherein said 

the detected distortions by controlling the drives of said ]5 two-dimensional array of reference points are produced by 

projectors. the ends of optical fibers carried by said screen. 

12. The apparatus according to claim 1, wherein said 19. The method according to claim 14, wherein an image 
calibration system also detects and corrects color conver- patn correction table is also generated for each modular unit 
gence distortions by: f or correcting discrepancies between the known locations of 

imaging a plurality of neighboring projected regions to 20 said two-dimensional array of reference points on said 

produce an optical image of such neighboring regions screen and the corresponding locations of the two- 

on an image sensor; dimensional array of reference points as imaged on said 

analyzing said optical image to estimate the color con- screen, 

vergence distortions in the color pixels of said image; 20. The method according to claim 14, wherein said 

and digitally relocating each color pixel in said combined 25 two-dimensional array of reference points on said screen are 

display a sub-pixel value to correct for said color utilized to combine the displays of the modular units such as 

convergence distortions. 10 eliminate overlaps and gaps in said combined display. 

13. The apparatus according to claim 1, wherein; 21. The method according to claim 14, wherein the light 
each projector includes a Fresnel lens which collimates is s f eDSed at each of a of ^ aced loc ( ations f 

the light from the respective projector; 30 00 * e ^ r face of said scre ^ ^ ^ Uc f pr ^ Ct % S °[ 

t , said modular units are controlled to make uniform their light 

said screen being a common screen having a light- intensities 

diffusing surface overlying all said Fresnel lenses; u ^ method according t0 claim 14> whe rein: 

and wherein said apparatus further includes a blocking eacfa of sai(J projectors mchldes a drive having a phjrality 

element underlying junctures between adjacent Fresnel 35 of degrees of m0V ement; 

lenses in order to reduce overlapping of the light from , . . . /• • , • \ * « j , 

f , • . _ 1 . , . ^JLJi 0 w , m1 „ c ^ m and the dnves of said projectors are controlled to correct 

the projectors and thereby to produce a seamless com- r . J 

bined dis la some of the detected distortions. 

14. "a melted producing an electro-optical display, A . meth ° d icco ^}° ^aim 14 wherein color 
... distortions are also corrected by detecting the intensity or 

comprising. 40 color component in the combined display; and modi- 
providing a plurality of modular units each including a fying ^ electrical signals applied t0 said pro jector of each 
projector for receiving electrical signals, converting modular ^ tQ corfect ^ ^atomed display with respect 
them to optical images, and projecting said optical tQ said colof distortionS- 

images via an optical projection system on a screen; u The melhod according to claim 14j wherein color 

arranging said plurality of modular units in a side-by-side 4 * convergence distortions are corrected by: 

array such as to combine their respective displays to imaging a plurality of neighboring pro jected regions to 

produce a combined display; produce an optical image of such neighboring regions 

imaging said screen via imaging means spaced from the on an i ma ge sensor; 

screen and producing an image of the screen on an aaa i yzing ^ optical' image to estimate the color con- 
image sensor on the same side of the screen as the vergence distortions in the color pixels of said image; 
projectors of the modular units for detecting geometri- 1 u 1 • i- -j l - j 
cal distortions in said combined display; and digitaUy relocating each color pael m sa,d combmed 

/ \ display a sub-pixel value to correct for said color 

and modifying the electrical signals applied to said pro- convergence distortions, 

jector of each modular unit to correct said combmed S5 25 ^ method according t0 claim 14> whe rein; 

display with respect to said detected geometrical dis- , . , , . „ , . , 

* J- u j • „ ■ r „, „ „r * each projector includes a Fresnel lens which collimates 

tortions by producing a two-dimensional array of ref- \iJh fr the res ective ro'ector 

erence points at known locations on the face of said e gn m p P J > 

screen, and generating a projector-path correction table and a common screen having a light-defusing surface 

for each modular unit for correcting discrepancies 6Q overlying all said Fresnel lenses; 

between the known locations of said two-dimensional and a blocking element is provided to underlie the junc- 

array of reference points on said screen and the corre- ture between adjacent Fresnel lenses in order to reduce 

sponding locations of the two-dimensional array of overlapping of the light from the projectors and thereby 

reference points as projected on said screen. to produce a seamless combined display. 

15. The method according to claim 14, wherein said 

two-dimensional array of reference points are produced by * * * * * 
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